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BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention generally relates to computer server systems. More particularly, 
the present invention relates to computer server systems having a modular architecture. 

2. Discussion of the Related Art 

Consumers today embrace an expanding array of Internet applications, and businesses are 
jumping on the e-commerce bandwagon to take advantage of this growth. Internet Protocol (IP) 
services are the key to the phenomenal growth in Web hosting. Hosting, in turn, drives 
utilization of bandwidth supplied by the backbone network. For those who own backbone 
networks, the focus is about selling bandwidth — the amount of data that can be transmitted in a 
fixed amount of time. The builders of this infrastructure today control the growth of the Internet. 
At the heart of the infrastructure are servers, which are the engines that drive IP services. 

Those who have built and operate data centers that interface to the Internet backbone 
network strive to provide a secure, managed, and reliable environment in which to host IP 
services, which they sell along with Internet bandwidth, so as to optimize profitability. But, 
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backbone network providers have also become data center operators because they have seen that 
data centers sell more IP services and therefore generate even more revenue from sales of their 
network bandwidth. 

Next generation Application Service Providers (ASPs) are writing applications to provide 
even more IP services. To date, e-mail is the number one selling ASP package. The growth in 
wireless Internet and other innovations will further expand these services. In the case of the 
ASP, its IP service is the revenue generator. A data center hosts the ASP's IP service, and 
somewhere, a backbone network provider is selling bandwidth to the data center operator. 

Revenue generation is dependent on the Internet data center and its entire infrastructure. 
Building and operating an Internet data center is very costly. Data centers constructed today to 
house as many as 10,000 servers cost upwards of $150 million to build and outfit. These 
facilities have been proclaimed the most expensive real estate on the planet. Added to that are 
the operational resources required to keep a 24 hours, 7 days a week, 365 days a year data center 
running smoothly. Therefore, if the servers in the data centers are the engines powering IP 
services, it becomes very clear that every data center requires a few thousand really good, 
"bulletproof engines to enhance revenue generation and help control infrastructure costs. 

The servers installed in Internet data centers typically utilize more physical space and 
more power than they actually require to perform their tasks. These server systems are often 
constructed with less than optimal quality components. Many server systems have poor 
reliability relative to the large number of units installed, which may range from the hundreds to 
the thousands, and as a result have high maintenance and operational costs. With today's 
skyrocketing real estate costs, it is an important consideration for data centers to efficiently use 
the floor space available for the server systems. Moreover, server systems are generally very 
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cumbersome and time consuming to deploy and repair, and the costs associated with the time it 
takes to deploy or repair a server also makes a significant impact on the bottom line for a data 
center operator. 

Therefore, there is a need for a compact, high-density, rapidly-deployable, high- 
5 availability server system having simplified management and serviceability, and unlimited 

scalability. The server system would provide higher revenues for data center operators, top-of- 
the-line performance, and cost savings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 illustrates a modular server system according to an embodiment of the present 
invention; 

Fig. 2 illustrates a first side view of a modular server system according to an embodiment 
of the present invention; 

Fig. 3 illustrates a second side view of a modular server system according to an 
embodiment of the present invention; 

Fig. 4 illustrates a perspective view of a modular server system according to another 
embodiment of the present invention; 

Fig. 5 illustrates a server blade according to an embodiment of the present invention; and 
Fig. 6 illustrates a media blade having a connection with a server blade via a midplane 
according to an embodiment of the present invention. 
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DETAILED DESCRIPTION 

Fig. 1 illustrates a modular server system according to an embodiment of the present 
invention. The modular server system 1 00 is provided for Web hosting and ASPs requiring 
server solutions with carrier-class availability, reliability, and scalability. Carrier-class systems 
5 have features that are more demanding than enterprise-grade systems, such as "high availability" 
(HA), high dependability and redundancy. Carrier-class systems are typically used in business- 
critical applications including telecommunications and data communications where system up- 
time is crucial. In the telecommunications industry, high availability servers are redundant 
servers that achieve 99.999% up-time, often referred to as "five nines". 

€5 At the heart of the modular server system 100 is the midplane 170, which may be a PC- 

yj 

S style circuit board having a plurality of blade interfaces 420 (see Fig. 4) providing a common 
q interconnect for all modules connected thereto. The blade interfaces 420 are in electrical 
S communication with each other and with the system management bus (discussed below) of the 
01 midplane 170. The midplane 170 is preferably based on a CompactPCI form factor 
^5 (CompactPCI Specification, PICMG 2.0, Version 2.1, by the PCI (Peripheral Component 
5=3 Interconnect) Industrial Computer Manufactures Group (PICMG)), wherein the blade interfaces 
420 are CompactPCI slots or connectors. CompactPCI utilizes the Eurocard form factor 
popularized by the "Versa Module Europa" (VME) bus having standard Eurocard dimensions 
and high-density 2mm pin-and-socket connectors. In the modular server system 100 illustrated 
20 in Fig. 1, up to sixteen independent server blades 110 may be supported, along with up to sixteen 
media blades 150. However, any other numbers of server blades 1 10 and media blades 150 may 
be supported. A blade is generally a mother board or a single board computer (SBC) having a 
central processing unit (CPU). Although it is preferable that each server blade 110 have a 
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corresponding media blade 120, it is not a requirement, as multiple server blades 1 10 may share 
a single media blade 120, and vice versa. By utilizing the midplane 170, the network (such as 
the local area network) becomes the primary interconnect between the blades 110, 150. Server 
blades 1 10 and media blades 150 are discussed in further detail below. 
5 The modular server system 100 illustrated in Fig. 1 is also adapted to support up to four 

switch blades 120 for complete system network (e.g., Ethernet) switching and N+l redundancy. 
In an embodiment of the present invention, the switch blades 120 have twenty 10/100 Base-T 
auto-negotiating ports and support 4,096 Media Access Controller (MAC) addresses. Preferably, 
of the twenty ports, sixteen of them are assigned to one Ethernet channel from the system's 100 
@ midplane 170 (connected to all sixteen server blades 1 10, as illustrated in the example in Fig. 1), 
£jf and the remaining four ports are accessible through RJ-45 (Ethernet) connectors, for example, on 
£ the switch blade's 120 face plate. However, other configurations may be adapted depending on 
J" the number of server blades 1 10 supported by the modular server system 100. Data packets are 
Or preferably buffered in the switch blade 120 so that Ethernet collisions do not occur on any 
UJ5 channel, and a full-managed Layer 3/4 switch may provide Quality of Service (QoS) control, 
" while in all cases a non-block switch fabric with sufficient bandwidth to prevent packet loss is 
recommended. 

According to an embodiment of the present invention, two switch blades 120 are utilized 
for a fully-functional modular server system 100, and additional switch blades 120 may be added 
20 for high availability redundancy. In a system 100 with four switch blades 120, for example, one 
can be assigned to Ethernet channel A for system management traffic, and another to channel B 
for Web traffic, while the remaining two may be placed in standby mode for hardware and/or 
software fail-over capability. 



-5- 



PATENT 
81674-280175 

In the modular server system 100 illustrated in Fig.. 1, up to six load sharing power 
supplies 130 (Power Supply #5 not shown in Fig. 1) may be connected to the midplane 170 to 
provide power to the modules of the server system 100. These power supplies 130 (e.g., 150W 
power supplies) may provide for N+l redundancy as well. Up to two power (AC/DC) inputs 140 
5 may be connected to the midplane 170 to provide input power to the modular server system 100. 
A removable fan tray with cooling fans 160 (see also Fig. 2) may be utilized to provide cooling 
air flow within the modular server system 100 to cool the modules therein. According to an 
embodiment of the present invention, the removable fan tray 160 may include up to six fans for 
N+l redundancy." The power supplies 130 and the cooling fans 160 of the modular server system 
y£0 100 may be shared by the server blades 110 and media blades 150 within the modular server 
2 system 100 (i.e., each server blade 1 10 or media blade 1 50 need not have its own power supply 
£ or cooling fan). The sharing of the power supplies 130 and cooling fans 160 provides a more 
J" efficient use of the resources of the modular server system 100 and minimizes space, 
pi Fig. 2 illustrates a first side view of a modular server system according to an embodiment 

UU5 of the present invention. According to an embodiment of the present invention, up to sixteen 
N= server blades 1 10 may be accommodated by the modular server system 100 at its first side. Two 
switch blades 120, such as 20-port Ethernet switches, may be accommodated on the first side of 
the modular server system 100. Up to four power supplies 130 may be accommodated on the 
first side of the modular server system 100 as well. The removable fan tray 160 may also be 
20 installed and removed from the first side of the modular server system 100. Mounting flanges 
210 on the modular server system 100 allow for front, mid, or rear rack mounting. 

Fig. 3 illustrates a second side view of a modular server system according to an 
embodiment of the present invention. According to an embodiment of the present invention, up 
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to sixteen media blades 150 may be accommodated by the modular server system 100 at its 
second side. Two switch blades 120 may be also accommodated on the second side of the 
modular server system 100. Up to two power supplies 130 and two power inputs 140 may be 
accommodated on the second side of the modular server system 100 as well. A power switch 
5 3 10 for the modular server system 400 may also be provided on the second side. A rear 

removable fan tray 320 may also be installed and removed from the second side of the modular 
server system 100. Although the server blades 1 10 and media blades 150 are preferably 
connected to the midplane 170 at opposite sides, that is not a requirement. The midplane 170 
may be configured so that the server blades 110 and media blades 150 are connectable to the 
JC0 midplane 170 on the same side. 

EQ Fig. 4 illustrates a perspective view of a modular server system according to another 

J: embodiment of the present invention. The modular server system 400 in Fig. 4 is adapted to 
I* accommodate up to four server blades 410, and up to four media blades 450. A chassis 440 may 
[11 be provided to enclose the modular server system 400. The midplane 470 provides a common 
Llj5 interconnect for all modules connected thereto, including the server blades 410 and media blades 
H 450. According to the embodiment in Fig. 4, up to three power supplies 430 may be 

accommodated by the modular server system 400. A cooling fan system 460 is also provided to 
provide cooling air flow to the modules of the server system 400. According to an embodiment 
of the present invention, the server blade 410 connected to the midplane 470 may include a 500 
20 MHz Intel Pentium III processor 480, 256 KB on-die L2 cache, and a 256 MB error correcting 
coded (ECC) synchronous-dynamic random access memory (SDRAM) 490. However, any 
suitable central processing unit (CPU) and memory devices may be utilized. When the server 
blades 410 and media blades 450 are installed and configured in the modular server system 400, 
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they operate like any other server system, utilizing available operating systems such as Microsoft 
Windows NT Server 4.0 (Service Pack 6a). 

Fig. 5 illustrates a server blade according to an embodiment of the present invention. The 
server blade 500 is preferably a telecom-style CPU board designed to work as a modular 
5 component of the server system 100 (see Fig. 1). When the server blade 500 is paired up with a 
media blade 150, the combination becomes an independent server within the modular server 
system 100, and therefore the modular server system 100 itself may house a plurality of 
independent servers. According to an embodiment of the present invention, the server blade 500 
is designed according to the CompactPCI form factor. The Compact PCI form factor is an 
yFp industry standard that provides a rugged, modular, high performance platform for the server 
ffl blade 500. However, any suitable interface standard may be utilized, though. The CompactPCI 
jF form factor also enables "hot swap" functionality in a multi-server environment of the modular 
^ server system 100, meaning that the server blade 500 may be replaceable (removed from or 
S installed into the modular server system 1 00) without powering down the entire system 
jlj5 (CompactPCI Hot Swap Specification, PICMG 2. 1 , Version 1 .0, by the PCI (Peripheral 
M Component Interconnect) Industrial Computer Manufactures Group (PICMG)). Hot swapping 
allows a faster mean time to repair (MTTR) for damaged components or modules, such as field 
replaceable units (like server blades 1 10, media blades 150, power supplies 130, and the fan tray 
160), within the modular server system 100. 
20 The server blade 500 illustratively includes a CPU 516, such as the Intel Pentium III 

processor mobile module. The Pentium III processor module contains a power supply for the 
processor's unique voltage requirements, a temperature sensor, a system memory (L2 cache), 
and core logic required to bridge the processor to the standard system buses. In an embodiment 
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of the present invention, the server blade 500 incorporates a system management bus, in 
communication with the system management bus of the midplane, for access to system-wide 
monitoring and alarming functions. The system management bus allows the server blade 500 
(e.g., one server blade 500 may be designated as the Active Manager utilizing server system 
5 management software) to communicate with the midplane 1 70 system management bus to 
monitor the midplane 170 and the modules (e.g., the server blades 110, media blades 150) 
connected thereto, to monitor on-board operating voltages and temperatures, and can be further 
configured to "trip" an alarm if thresholds are exceeded. 

The server blade 500 illustrated in the example of Fig. 5 also includes a pair of network 

K I 

ip interfaces 506, 507. According to the embodiment of Fig. 5, dual Ethernet ports 506, 507 are 

EG 

CO provided. The Ethernet interfaces 506, 507 may utilize the Ethernet Express Pro 100 compatible, 
J Intel 82559 Fast Ethernet Multifunction PCI Controller. The 82559 controller includes both the 

i = I 

2* Media Access Controller (MAC) and the physical layer (PHY) interface combined into a single 

D 

m component solution. The network interfaces 506, 507 may be RJ-45 connectors on the faceplate 
Uj5 of the server blade 500, and the faceplate may also include status LEDs 504 to indicate the status 
of each channel. 

Semiconductor memory 510 is preferably utilized by the server blade 500 for local 
memory, such as a SDRAM dual-inline memory module (DIMM). Preferably, the SDRAM 
utilized is error correcting coded (ECC), which corrects single bit errors and reports multiple bit 
20 errors to the operating system. The server blade 500 may also provide on-board flash memory 
512 for storing the system basic input/output system (BIOS), and for use as a solid-state disk. A 
battery-backable static random access memory (SRAM) may also be provided for this use as 
well. 
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The server blade 500 preferably includes interrupt controllers 526, such as 8259-style 
controllers, which provide support for level-triggered and edge- triggered inputs, individual input 
masking, and fixed and rotating priorities. A push-button reset/abort button 503 may also be 
provided to allow a user to reset the server blade 500. A keyboard/mouse connector 501 allows a 
5 user to connect a keyboard or mouse to the server blade 500 for interaction therewith. 
Optionally, a video output plug 505, such as a VGA connector, may be provided to allow 
connection to a monitor for video output. A universal serial bus (USB) 508 connector may also 
be provided to allow the server blade 500 to connect to other devices (e.g., portable optical disc 
drives, hard disk drives, etc.) as required. 
r|p The server blade 500 may include a serial port 502, such as a 16C550 PC-compatible 

CO serial port, on the front panel. A real-time clock 534 with battery power 532 is preferably 
provided on the server blade 500 to perform timekeeping functions, such as alarm, maskable 

™ **i 

5 - : 

f periodic interrupt, and calendaring. A watchdog timer 528 may be optionally provided to 
rn monitor system operation and to be programmable for a number of timeout periods. Preferably, 
lifi a two-stage watchdog timer is utilized, that is, it can be enabled to produce a non-maskable 
H interrupt (NMI) before it generates a Reset Request. Therefore, failure to strobe the watchdog 
timer within the programmed time period may result in an NMI, a Reset Request, or both. A 
register is set if the watchdog timer caused the reset event. This watchdog timer is cleared only 
on power-up, enabling system software to take appropriate action on reboot. An input/output 
20 expansion connector 514 may be provided in the server blade 500 to allow expansion for 
interfacing with a storage medium, flash memory, etc. 

Fig. 6 illustrates a media blade having a connection with a server blade via a midplane 
according to an embodiment of the present invention. The media blade 1 50 is a modular 
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component of the modular server system 100, primarily adapted to carry a mass storage medium 
device such as a hard disk drive, as a companion to the server blade 1 10. However, the media 
blade 150 may also accommodate any other media devices, such as a graphics processing device, 
an audio processing device, a streaming media processing device, etc. In the embodiment 
5 illustrated in Fig. 6, the media blade 1 50 is adapted to support up to two 2.5 inch or 3.5 inch 
Integrated Drive Electronics (IDE) hard disk drives 610, 620. However, the media blade 150 
may support any type or number of hard disk drives that are or may become available, of 
different interface types, and the media blade 150 may contain other processors and devices that 
provide Redundant Array of Independent Discs (RAID) functionality, and may interconnect with 
y£p the PCI bus of the corresponding server blade 110. 

H Logically, the media blade 150 may lie on the server blade's 110 secondary IDE channel. 

^~ 

£ The hard disk drives 610, 620 are preferably jumpered for Cable Select (CSEL), a feature that 
" allows CSEL jumpered hard disk drives to automatically assume Drive 0/Drive 1 (Master/Slave) 
P identities when cabled to the appropriate headers on the media blade 1 50. The Cable Select 
yj5 feature is built into the printed circuit board (PCB) and not the IDE cables (the cables are 
identical to one another and provide pin-to-pin contact at each lead). 

According to an embodiment of the invention, the midplane input/output connector 650 
of the media blade 1 50 is a CompactPCI form factor interface adapted for connection with a 
blade interface of the midplane 170. Similarly, the server blade 1 10 may include midplane 
20 connectors 660, 670, 680 that are CompactPCI form factor interfaces adapted for connection 
with a blade interface of the midplane 170. The midplane input/output connectors 640, 660 of 
the media blade 150 and server blade 110, respectively, preferably include the secondary IDE 
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channel 640 for communication between the media blade 150 and the server blade 1 10 through 
the midplane 170, or may make use of the CompactPCI bus. 

In the embodiment illustrated in Fig. 6, the media blade 150 includes power sequencing 
circuitry 630 that causes the hard disk drives 610, 620 to power up in sequence. This procedure 
avoids overloading the system with excessive current demands when the hard disk drives' 610, 
620 spindle motors start up. 

In summary, the modular server system 100 provides a compact, modular, efficient, and 
powerful multi-server system that is highly reliable and easy to maintain. The high density of 
the modular server system 100 reduces real estate costs, and the modular nature of its field 
replaceable units allows repairs and replacements to be performed quickly and easily. 

While the description above refers to particular embodiments of the present invention, it 
will be understood that many modifications may be made without departing from the spirit 
thereof. The accompanying claims are intended to cover such modifications as would fall within 
the true scope and spirit of the present invention. The presently disclosed embodiments are 
therefore to be considered in all respects as illustrative and not restrictive, the scope of the 
invention being indicated by the appended claims, rather than the foregoing description, and all 
changes that come within the meaning and range of equivalency of the claims are therefore 
intended to be embraced therein. 
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